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Abstract 

Numerical  rootfindmg  problems  are  quite  common  in  stochastic  modeling. 
However,  many  solutions  stop  at  the  presentation  of  a  probability  generat¬ 
ing  function  for  the  state  probabilities.  But  with  increasing  easy  access  to 
computing  power,  many  problems  whose  answers  were  typically  left  in  in¬ 
complete  form  or  for  which  there  has  been  a  search  for  alternative  solution 
methods  are  currently  being  reexamined.  The  class  of  Markov  chains  with 
quasi-triangular  layouts  (i.e.,  those  having  sub-  or  super-triangular  sets  of 
zeros)  are  a  good  case  in  point.  They  have  an  especially  nice  structure  which 
leads  to  a  rather  concise  representation  for  the  generating  functions.  But  the 
complete  solution  then  requires  the  finding  of  roots.  Fortunately,  these  prob¬ 
lems  can  be  shown  to  have  special  properties  that  make  accurate  rootfinding 
quite  feasible.  In  this  paper,  we  show  that  the  roots  of  the  critical  equa¬ 
tions  for  these  models  are  indeed  unique  and  located  in  known  regions  in  the 
complex  plane.  j 
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1  INTRODUCTION 

As  Abolnikov  and  Dukhovny  (1987)  and  others  (for  example,  see  Bailey,  1954, 
and  Powell,  1985)  have  repeatedly  noted,  many  denumerable  discrete-time 
Markov  chains  (with  particular  applications  in  inventory,  dam  and  queueing 
modeling)  have  one  of  two  special  transition-matrix  structures.  These  forms 
have  been  called  quasi-triangular  by  a  number  of  authors,  because  of  the 
presence  of  sub-  or  super-triangular  sets  of  zeros: 
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The  structure  of  these  matrices  leads  to  some  particularly  concise  rep¬ 
resentations  for  the  probability  generating  functions  (PGFs)  of  the  Markov 
chain  equilibrium  state  process.  When  the  stationary  equation  for  such  a 
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Markov  chain  is  exercised,  the  PGF  of  the  steady-state  probabilities  has  an 
algebraic  function  in  its  denominator  whose  roots  are  critical  in  the  final  so¬ 
lution.  (We  henceforth  refer  to  this  denominator  function  equated  to  zero  as 
the  system’s  characteristic  equation). 

For  the  transition  matrix  A,  the  characteristic  equation  (CE)  turns  out 
to  be  (at  least  for  complex  z  with  absolute  value  <  1) 

=  f^a,z*  =  a(z),  (1) 

«=o 

where  K  is  as  defined  in  the  matrix  representation  A  (corresponding,  for  ex¬ 
ample,  to  a  constant  batch-input  module  in  bulk  queues).  Under  the  assump¬ 
tion  that  a(2)  possesses  all  its  derivatives  at  z  =  1  (i.e.,  that  the  distribution 
{a,}  has  all  moments),  a{z)  may  be  set  equal  to  the  Laplace-Stieltjes  trans¬ 
form  of  a  distribution  function  [call  that  A(t),  and  set  its  mean  to  l//i]  of  a 
nonnegative  random  variable  evaluated  at  A(1  —  z),  where  A  is  an  arbitrary 
positive  constant  for  the  time  being.  Thus  we  may  also  write  that 

zX  =  4-(A(1  -  2)|.  (2) 

The  CE  associated  with  the  matrix  B  may  be  written  as 

z^  =f^b,z*  =  0{z),  (3) 


-  z)l  (4) 

In  these  representations,  the  constant  K  is  as  given  in  B  (corresponding, 
for  example,  to  a  constant  batch-service  module  in  bulk  queues),  ^{z)  is 
defined  as  the  PGF  of  the  probabilities  {6,},  and  B*  is  the  Laplace-Stieltjes 
transform  of  a  distribution  function  [call  that  B(t),  and  set  its  mean  to  1/A]  of 
a  nonnegative  random  variable  evaluated  at  /i(l  —  z),  where  fi  is  an  arbitrary 
positive  constant. 

Recognize  that  Equations  (1)  and  (3)  are  generalizations  of  the  well- 
known  fundamental  equation  of  branching  processes,  typically  written  as 
2  =  f{z),  where  /  would  be  the  PGF  for  the  number  of  offspring  emanating 
from  one  parent.  Gross  and  Harris  (1985),  for  example,  provide  the  details 
of  the  root  problem  for  this  model.  In  actuality,  it  is  the  B  problem  which 
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is  in  fact  the  more  direct  relative  of  the  branching  process,  so  it  is  this  one 
on  which  we  comment  in  detail  first. 

The  CE  of  the  matrix  B  may  be  rewritten  in  the  standard  way  by  using 
z  =  rexp{i0),  and  we  find  that 

exp{i6K)  =  —  r  exp{i0))]exp{2‘irni)  (5) 

for  n  =  This  equation  clearly  has  a  root  at  unity,  and  by  Rouche’s 

theorem,  we  can  show  that  there  are  K  others  inside  the  unit  circle  \  z  1 
when  the  chain  is  ergodic.  The  condition  for  ergodicity  is  that 

/9'(1)  =  f;n6„  >  A' 

n=0 


or 

These  can  be  shown  to  be  equivalent  to  the  requirement  that  KX/p  <  1.  In 
addition  and  most  importantly,  for  each  n  in  (5),  there  is  a  unique  root  with 
absolute  value  less  than  1.  We  provide  the  proof  of  this  assertion  in  the  next 
section. 

The  roots  of  (5)  are  found  by  separately  solving  its  real  and  imaginary 
portions.  As  noted,  there  is  a  unique  answer  when  (5)  is  evaluated  for  in¬ 
dividual  values  of  n.  In  Section  2,  we  use  this  fact  to  complete  the  proof 
that  these  roots  are  indeed  unique.  In  addition,  we  are  able  to  pinpoint  the 
locations  of  all  of  the  real  roots. 

Partial  results  on  the  uniqueness  of  all  the  roots  for  this  model  type  are 
available.  It  is,  in  fact,  known  that  the  roots  are  totally  unique  when  B{t)  is 
Erlang(J)  distributed  with  mean  1/A  (see  Chaudhry  and  Templeton,  1983). 
In  this  case.  Equation  4  becomes  (for  KXjp—  Kp  <  1) 

z^  =  \Jpl{Jp-^{\-z)Y.  (6) 

To  prove  that  the  roots  are  simple,  we  show  that  the  derivative  vanishes  at 
a  potential  repeated  root,  say  z,.  This  is  equivalent  to  requiring  that 

Kz^-^  =  J{Jpy\Jp^{\-z,)]-^-'^^\  (7) 
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If  (6)  is  divided  by  (7),  we  see  that 

K{Jp+l)  J{l-Kp) 
y  +  A'  j  +  K  ' 

When  this  value  is  substituted  back  into  Equation  (6),  we  find  that  the 
condition  for  repetition  is  that 

or 

If  we  define  J/(J  +  A)asc,  then  the  condition  for  repetition  is  equivalent 
to  requiring  that 

(A'p)=  =  {Jp  +  1)(1  -  c)  =  (1  -  c)Jp  +  (1  -  c).  (8) 

The  right-hand  side  of  (8)  is  a  straight  line  in  p,  with  y-intercept  of  1-c 
and  slope  of  (l-c)J,  while  the  left-hand  side  is  a  monomial  with  positive, 
fractional  power  c.  The  two  functions  intersect  only  at  p  =  1  /K ,  which  would 
violate  the  condition  for  ergodicity  that  p  <  1/A,  so  that  the  assumption  of 
repetition  must  be  false. 

But  not  much  more  has  been  generally  known  about  the  effect  of  the  form 
of  the  distribution  B{t)  for  the  more  general  model. 

For  the  A-matrix  problem,  recall  that  the  characteristic  equation  is 

z"  =  4'|A(1  -  *)|,  (9) 

where  A*  is  a  Laplace-Stieltjes  transform.  Ergodocity  obtains  here  when 

n=0 


or 


dA*(A(l  -  z)] 


dz 


<  A. 


This  is  equivalent  to  requiring  that  X/Kfi  <  1. 

It  is  easily  shown  by  Rouche’s  theorem  that  (9)  has  K  roots  inside  and 
on  the  unit  circle,  including  the  root  z=l.  Abolnikov  and  Dukhovny  (1987) 
have  noted  that  all  the  roots  on  the  unit  circle  are,  in  fact,  simple.  We  show 
here  that  the  specific  root  z=l  is  simple  using  the  usual  derivative  test.  To 
do  so,  we  evaluate 


Kz^-^  =  -XdA\X  -  Xz)/dz 

at  z=l  and  find  that 

K  =  -X{-\/fi)  =  p, 

OT  p  =  K  y  which  is  a  contradiction  of  the  ergodic  condition  that  p  <  K . 
Hence  z=l  cannot  be  a  double  root. 

When  -4(/)  is  deterministic,  we  can  further  show  that  all  K-1  roots  inside 
or  on  the  unit  circle  are,  in  fact,  strictly  within.  This  follows  when  we  rewrite 
(13)  as 


and  assume  that  z,  has  absolute  value  of  1  but  is  not  precisely  equal  to  1. 
Then  we  see  that 


which  implies  that  ile(2,  —  1)  =  0  and  thus  that  z,  =  1.  But  this  is  contrary 
to  our  earlier  verification  that  the  root  z  =  1  is  simple. 


2  NEW  RESULTS 

We  first  show: 

Lemma  1  Equation  5  has  one  and  only  one  root  for  each  n. 
Proof:  Rewrite  (5)  as 

9<7m  r  /oo  1  1 

r  exp\i{e  -  ^)]  =  /  dB{i) 

h  Is/o 
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Let  f{z)  equal  the  left-hand  side  of  the  above  equation  and  g{z)  equal  the 
right-hand  side,  and  consider  the  circle  \  z\=\-S  =  C.  On  the  boundary, 


5(2)  l< 
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since  )  exp{—iCsin6)  |=  1.  Because  cos  6  <  1,  it  then  follows  that 

|1/K 


Jo 


I  ff(^) l< 

We  now  show  that  |  /(z)  (>  I,  for  then 

I /(z)  i>  /  >1  g(z)  I  . 
This  is  equivalent  to  showing  that 


I. 


F(C)  =  C  - 


[/“ 


dB(t)j 


il/K 


>  0. 


But  F(l)  =  0  and  F'(l)  =  1  -  /i/KX  <  0.  Thus 


lim  F(C)  >  0  and  F{1  —  ^)  >  0. 

C--*l  ~ 

Hence  f(z)  -f-  g(z)  =  0  has  the  same  number  of  roots  as  f(z)  =  0  inside 
I  2  1=  1,  namely,  1.  □□ 

We  know  that  the  B-matrix  model  has  K  roots  inside  the  unit  circle,  and 
as  promised,  we  now  show  that  these  values  are  indeed  unique. 

Theorem  1  The  roots  of  the  characteristic  equation  of  the  B~matrij  model 
are  unique,  with  one  real  root  in  (0,1)  for  all  values  of  K  and  a  second  real 
one  in  (-1,0)  only  when  K  is  even. 
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Proof  -.  Use  the  form  =  fi{z).  Then  by  a  geometric  argument  essen¬ 
tially  the  same  as  that  for  the  G /M/\  queue  used  in  Figure  5.1  of  Gross  and 
Harris  (1985),  it  follows  that  there  exists  a  unique  real  root  in  (0,1)  for  all 
K  when 


p'(l)>[d{z^)/dzUr. 


But  this  is  equivalent  to 


> 


which  is  true  from  ergodicity. 

For  K  even,  we  see  that  there  is  an  additional  real  root  in  (-1,0)  w'ith  a 
smaller  modulus  than  the  positive  root,  since  z^  is  a  symmetric  function  and 
0  <  0{-z)  <  0{z)  for  z  6  (0,1). 

From  Lemma  1,  we  know  that  (5)  has  a  unique  root  inside  the  unit  circle 
for  each  n  =  1,...,  A';  call  it  (r„,0„).  But  it  is  also  true  that  (8)  has  a  unique 
(possibly  non-integer)  value,  n,,  for  each  pair  ('r,,^,).  Thus  if  we  assume  for 
i  ^  j  that  (r,,0,)  =  it  follows  that  n,  =  n^.  But  this  contradicts 

the  uniqueness  of  {r,B)  for  each  n.  Therefore  all  K  roots  (r„,0„)  must  be 
distinct.  □□ 

Remember  now  that  the  A-matrix  models  have  characteristic  equation 


z^  =  A*{>,~\z)  =  a{z).  (10) 

As  noted  earlier,  this  equation  has  exactly  K  roots  inside  or  on  |  z  1=  1.  If 
A*  is  a  rational  function  whose  denominator  is  of  degree  r,  then  it  clearly 
follows  that  there  are  r  +  K  roots,  with  r  of  them  outside  the  unit  circle.  For 
the  queueing  version  of  this  problem  (that  is,  the  model  AI /I),  r  =  1 
and  there  is  therefore  exactly  one  root  outside  the  unit  circle,  which  is,  in 
fact,  real.  It  turns  out  that  all  such  A-matrix  problems  have  exactly  one  root 
greater  than  1  (and  therefore  have  at  least  one  root  in  the  complex  domain 
outside  the  unit  circle).  The  proof  of  this  follows. 


Theorem  2  The  characteristic  equation  of  the  A-matnx  problem  always  has 
one  real  root  greater  than  1.  Furthermore,  there  is  always  an  additional  real 
root  in  (  —  1,0)  for  K  even,  but  not  fo.  K  odd. 
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Proof:  The  verification  that  there  is  always  a  real  root  in  (l,oo)  comes 
from  an  analysis  virtually  identical  to  that  used  for  the  B-matrix  problem. 
Similar  to  before,  use  the  probability  generating  function  a{z)  as  the  right- 
hand  side.  Then  the  first  intersection  of  with  this  pgf  occurs  at  2  =  1 
whenever  a'(l)  >1.  In  addition,  there  is  a  guaranteed  later  intersection 
since  the  slope  of  0(2)  must  eventually  exceed  that  of  at  some  point. 

The  existence  of  a  second  real  root  in  (—1,0)  for  K  even  follows  from 
the  fact  that  the  function  a(z)  is  monotone  increasing  and  z^  is  symmetric. 
Thus  the  intersection  must  occur  at  a  point  with  absolute  value  less  than 
that  of  the  first  intersection  on  the  positive  real  line,  namely,  2  =  1.  □□ 

3  CONCLUDING  REMARKS 

Of  course,  we  recognize  that  the  location  of  roots  in  the  complex  plane  is  only 
part  of  the  problem.  It  remains  to  develop  effective  numerical  procedures  to 
take  advantage  of  the  information.  Our  current  research  is  partly  devoted  to 
this  development. 
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